AN OPEN IMAGE THEOREM FOR A GENERAL CLASS OF 

ABELIAN VARIETIES 



CHRIS HALL 



Abstract. Let K be a number field and A/K be a polarized abelian variety 
with absolutely trivial endomorphism ring. We show that if the Neron model of 
A/K has at least one fiber with potential toric dimension one, then for almost 
all rational primes £, the Galois group of the splitting field of the ^-torsion of A 
is GSp 29 (Z/£). 



1. Introduction 

Let if be a number field and A/K a polarized abelian g-fold with trivial K- 
endomorphism ring. For each rational prime I, let Ap denote the ^-torsion of A 
and Gi the Galois group of the splitting-field extension K{A()/K. If g = 1, then 
A/K is an elliptic curve and a well-known theorem of Serre asserts that Gt is iso- 
morphic to GSp 2 (Z/£) ~ GL 2 (Z/£) for all sufficiently large £ (321 Theorem 2]. In a 
series of lectures and letters Serre (cf . |S4l Corollaire au Theoreme 3] ) later showed 
how to extend the result to the case when g is odd, 2, or 6: if I is sufficiently large, 
then Gt ~ GSp 29 (Z/£). However, for general g it is an open problem to show that 
Ge is as big as possible for almost all £. In this paper we show that this is true when 
we assume an additional hypothesis on the reduction of A, and our main theorem 
is the following. 

Theorem 1. Suppose A/K satisfies the following property: 

there is a finite extension L/K so that the Neron model of A/L over 
(T) : the ring of integers Gl has a semistable fiber with toric-dimension 
one. 

If £ is sufficiently large with respect to A and K, then Gp ~ GSp 29 (Z/£). 

The rest of this paper is devoted to a proof of the theorem. In section [2] we prove 
the theorem modulo a result of Serre on the rigidity of inertial tori, and in section [3] 
we prove the necessary rigidity result. 

An example due to Mumford shows that one cannot remove hypothesis (T) from 
the statement of our theorem [MJ Section 4]. More precisely, Mumford constructed 
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an abelian 4-fold with absolutely trivial endomorphism ring such that Gi does not 
contain Sp 2s (Z/^) for infinitely many I. His 4- fold does not satisfy hypothesis (T) 
because it has potentially good reduction everywhere; for infinitely many £ there 
are no non-trivial unipotent elements u E Ge satisfying (u — l) 2 = 0, while potential 
positive-dimension toric reduction would give rise to such elements. More impor- 
tantly, Mumford's example fails to satisfy the conclusion of the theorem because its 
so-called Mumford-Tate group is strictly smaller than for those 4-folds addressed in 
the theorem (cf. [S3l annotation 4]). However, the groups Gi are as big as possible 
for almost all I once one takes into consideration the upper bound imposed by the 
Mumford-Tate group, and for a general polarized abelian g-fold A/K it is conjec- 
tured that Gi is almost always as big as possible given the constraints imposed by 
the endomorphism ring and Mumford-Tate group. 

While Mumford's example shows that an arbitrary abelian (7-fold will not satisfy 
the hypothesis (nor the conclusion) of the theorem, one can ask for the likelihood 
that a "random" A/K will have absolutely trivial endomorphism ring and satisfy 
hypothesis (T). For g = 1, a necessary and sufficient condition is that j-invariant 
does not lie in the ring of integers of K. For g > 1, if n = 2g + 2 or 2g + 1 and 
f(x) is a degree-n polynomial in K[x] whose splitting field has Galois group S n , 
then Zarhin showed that the endomorphism ring of the Jacobian of the hyperelliptic 
curve y 2 = f(x) is absolutely trivial [Zj Theorem 2.1]. If moreover there is a prime 
p in K such that the reduction of f(x) modulo p (is defined and) has n — 1 distinct 
zeros (over an algebraic closure), one of which is a double zero, then the Jacobian 
satisfies (T). 

In an appendix to this paper E. Kowalski shows that most monic polynomials in K[x] 
with integral coefficients satisfy both these properties, thus for most hyperelliptic 
curves over K the Jacobian satisfies the hypotheses of the theorem. Of course, 
for g > 2 most polarized abelian g-folds A/K do not arise as the Jacobians of 
hyperelliptic curves, so it is an open problem to determine how often the hypotheses 
of the theorem are satisfied in general. 

1.1. Notation. We use the notation t ^>x to mean that there is a constant £o(X) 
which depends on the object X and £ satisfies £ > £o(X). 

2. Proof of Main Theorem 

Up to replacing K by a finite extension L/K we may assume A/K satisfies (T) for 
L = K. We fix an odd prime £ which is relatively prime to the polarization degree 
of A. We regard V = An as a vector space over Z/£ and write ( , ) : V x V — > m for 
the Weil pairing; the pairing exists because A is polarized and it is non-degenerate 
because I is prime to the polarization degree. If W < V is a subspace, then we 
write W 1 - for the complement of W with respect to ( , ). We identify T = GSp(y) < 
GL(V) with the similitude subgroup of ( , ) and Sp(V) < T with the isometry group. 
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There is short exact sequence 

i -» Sp(y) -» GSp(y) ™ (z/^) x -> 1 

such that, for every 7 £ T and x,y S V, we have (jx,jy) = (x,y) m ^\ The action 
of G = Gi is compatible with ( , ), so there is an embedding G — ► T and the theorem 
asserts it is an isomorphism if I ^>a 0- To prove the theorem we will construct a 
subgroup R < G which we can show satisfies R = Sp(V) for I ~^>a 0, from which it 
will follow easily that G = T for I ^$>a,k 0. 

Lemma 2. If £ ^$>a 0, then V is an irreducible G-module. 

Proof. If W < V is a G-submodule, then the isogeny A — » B = A/W is defined 
over K. If fa, fa : A — *■ B were isogenies for distinct I, then ip = fa o 0| would be 
an endomorphism outside of Z because deg(ip) deg(Z), so distinct I give rise to 
distinct elements of the -fT-isogeny class of A. However, Faltings' theorem implies 
there can only be finitely many abelian varieties in the X-isogeny class of A (cf. [D| 
Corollaire 2.8]), so there are only finitely many I such that V is reducible. □ 

We say 7 € T is a transvection if it is unipotent and V r7=1 has codimension one. The 
T-conjugate of a transvection is a transvection, and we write R < G for the normal 
subgroup generated by the subset of transvections in G. The proof of the following 
lemma shows that condition (T) is sufficient, but not necessary, to show that R is 
non-trivial for almost all £. 

Lemma 3. If £ ^$>a 0, then R is non-trivial. 

Proof. Suppose p is a prime in Ok over which A has toric-dimension one; p exists 
because A satisfies (T) for L = K. Then the monodromy about p is a transvection 
provided (. does not divide the order of the component group of the Neron model of 
A over p (cf. 2.1, 2.5 and 3.5 of [G]). □ 

Suppose R is non-trivial. Let W < V be a non-trivial irreducible i?-submodule and 
H < G be the stabilizer of W. 

Lemma 4. If V is an irreducible G-module, then W n W 1 - = W R = and V = 
®g/h9W. 

Proof. This follows from (the proof of) lemma 3.2 of [H] because (gW)' L = g{W^~) 
for all g G V. □ 

Suppose V is an irreducible G-module, and let R g < R be the subgroup generated 
by the transvections which act non-trivially on gW . The image of R g = gR±g _1 
in Sp(gW) is non-trivial, irreducible, and generated by transvections, so is all of 
Sp(gW) by (ZSl Main Theorem]. 

Lemma 5. If g±H 7^ gi H as cosets, then the commutator [R gi ,R g2 ] is trivial. 
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Proof. Note, g\W = g%W if and only if g\H = Q2H. If 7 £ R is a transvection 
which acts non-trivially on g\ W, then (7 — 1)V < 31 VF. Thus if giVF 7^ #2^, then 
(7 — l)g2W lies in g\W n (fel 7 ^ = 0, so acts trivially on giW . In particular, if 
71 € R gi , 72 € -R 92 are transvections and g\W 7^ g?W ■, then for each gPF, at least 
one of 71,72 acts trivially on gW, so the restrictions of 71,72 to gW commute (for 
every coset gH), hence they commute on all of V. □ 

The lemma implies R g = Sp(gW) for all gH and R is the central product Hg/h ^s- 
Therefore, if we write n = [V : W], then N-p(R) is isomorphic to the wreath product 
GSp(W) I S n and G < Nr(R). The next step is to show that n = 1. 

Let N < N r (R) be the kernel of N r (R) -> S„. 

Lemma 6. Let ir be a prime in Ok and let e be the ramification index of ir over Q. 
If £ > en + 1 and I < G is the inertia subgroup of a prime in K(Ag) over ir, then 
the image of I in S n is trivial. 

Proof. If £ > n, then S n has no elements of order £, so the image in S n of the 
^-Sylow subgroup of I must be trivial. In particular, if ir does not lie over £, then 
/ is an £-group because it is trivial or generated by a unipotent element, so the 
image of I in S n is trivial. Therefore we may suppose tt lies over £. Let C < I be a 
complement of the £-Sylow subgroup; it is a cyclic subgroup of order prime to £. By 
section 1.13 of |Slj (following [R]), there is a finite extension Fpd/Fe and a surjective 
homomorphism T = F* d — > C so that the representation T — > GL(1/) has amplitude 
at most e; see section [3] for the definition of amplitude. The kernel of T — > 5 n 
has index at most n in T and it commutes with Z(Nq) (because it lies in iVo), so 
lemma [9] of section [3] implies all of T commutes with Z{Nq) because £ > en + 1. In 
particular, the centralizer of Z(iVo) in N-p(R) is iVo, so C, the image of T — > GL(V), 
and I lie in iVo- □ 

The lemma implies that the fixed field of the kernel of G — > S n is unramified and has 
uniformly bounded degree over K. By a theorem of Hermite, there are only finitely 
many such extensions, so up to replacing K by a finite extension we may assume that 
the image of G in S n is trivial (for all £ > A 0). Therefore G < N = \\ G / H GSp(gW) 
and hence n = 1 because G acts irreducibly, so W = V and R = Sp(V). Once we 
know that R is big, the following lemma completes the proof of the theorem. 

Lemma 7. If R = Sp(V) andl^> K 0, i/ien G = T. 

Proof. If ^ 3>t<- 0, then K and Q(ne) are disjoint extensions of Q. On the other 
hand, if R = Sp(V), then G/R is the Galois group of K(ne)/K, so must be all of 
(Z/£) x for£^> K 0. ' " □ 

Remark: Most of the above carries through if we replace K by a global field of 
characteristic p > 0. One key difference is that Gi is no longer equal to GSp 29 (Z/£) 
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for all £ ^>a 0, but it does contain Sp 29 (Z/£) for all £ ^>a 0. Another difference is 
that the argument in lemma [6] is made simpler by the fact that there are no inertial 
tori to contend with for £ ^ p. 

3. Rigidity of Tori 

Let T be the multiplicative group of a finite extension F^d/F^. We regard T as 
the set of F^-points of the algebraic torus T/F^ given by the Weil restriction of 
scalars of the split one-dimensional torus G m /Fgd. The d fundamental characters 
tpi , . . . , ij)d : T — > G m corresponding to the d embeddings ¥ £ d — > F^ form a basis 
for the character group Hom^ (T, G m ). We define the amplitude of a character 
X = Yli i'T as rnaxj(ej), and we say \ 15 ^-restricted if < ei < £ — 1 for all i and 
ei < £ — 1 for some i (cf. [S 11 section 1.7] and [S4l annotation 5]). 

Let F^/F^ be a finite extension and V/¥\ be a finite-dimensional vector space. We 
say a representation p : T_ — > GL(V) of algebraic groups over F^ is ^-restricted if 
all its characters are ^-restricted. Every representation p : T — > GL(V) extends 
uniquely to an ^-restricted representation p : T — > GL (V), and we define the ampli- 
tude of p as the maximum of the amplitudes of its characters. 

Lemma 8. Let s G GL(V) be a semisimple element and p : T — > GL(V^) be a 
representation of amplitude e < £ — 1. If p(T) commutes with s, then p(T) commutes 
with s in GL (V). 

Proof. Up to a base change by a finite extension of F\, we may assume that s is 
diagonalizable in GL(U). Thus there is a decomposition V = ®jVj so that s acts 
on Vj via an element Sj € Z(GL(Vj)) and T preserves the decomposition because 
it commutes with s. The amplitude of the restriction pj : T — > GL(V 7 ) is at most 
e. If we write pj : T — > GL (Vj) for the ^-restricted representation corresponding to 
pj, then Pj(T_) commutes with Sj because Sj is a scalar. In particular, the compo- 
sition of the product representation T — > ]~[ ■ GL (Vj) with the obvious embedding 
GL (V^) — > GL (V) is an ^-restricted representation extending p : T — > GL(V), so 
it must be p : T — > GL (V) and hence p(T) commutes with s. □ 

The power of the previous lemma is that it allows us to show that representations 
p : T — > GL(V) are 'rigid' if they have sufficiently small amplitude (cf. [S4j ) . 

Lemma 9. Let s £ GL(V) be a semisimple element and p : T — > GL(V) be a 
representation of amplitude e. If S <T is a subgroup such that p(S) commutes with 
s in GL(V) and e ■ [T : S] < £ — 1, then p(T) commutes with s in GL(V). 

Proof. Let c = [T : S] and p c : T — > GL(V) denote the composition of p with the 
cth-power-map c : T — > T. By assumption p c has amplitude e ■ c < £ — 1, hence 
the corresponding ^-restricted representation p c : T - ► GL (V") is the composition of 
the ^-restricted representation p : T—>- GL fV) with the cth-power-map c : T—> T. 
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Moreover, p c (T) < p(S) commutes with s in GL(V), so by the previous lemma 
p c (T_) commutes with s in GL(V). In particular, c : T — > T is surjective because 
< c < I — 1, hence p(T) and a foriori p(T) commute with s. □ 
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Appendix: Most hyperelliptic curves have big monodromy 

Emmanuel KowalskQ 

Let k/Q be a number field and Z/% its ring of integers. Let / € TLk\X\ be a monic 
squarefree polynomial of degree n = 2g + 2 or 2g + 1 for some integer g > 1, and let 
Cf/k be the (smooth, projective) hyperelliptic curve of genus g with affine equation 

C f : y 2 = f(x), 

and Jf its jacobian. 

1 ETH Zurich - DMATH, kowalski@math.ethz.ch 
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In the previous text, C. Hall has shown that the image of the Galois representation 
Pfjt : Gal(fc/fc) -» Aut(J/[<|(jfe)) ~ F 2 / 

on the ^-torsion points of Jj is as big as possible for almost all primes £, if the 
following two (sufficient) conditions hold: 

(1) the endomorphism ring of Jf is Z; 

(2) for some prime ideal p C Z&, the fiber over p of the Neron model of Ct is a 
smooth curve except for a single ordinary double point. 

These conditions can be translated concretely in terms of the polynomial /, and are 
implied by: 

(1') the Galois group of the splitting field of / is the full symmetric group & n (this 
is due to a result of Zarhin [Z], which shows that this condition implies (1)); 

(2') for some prime ideal p C Z^, / factors in F p = Z^/pZ^ as / = fa fa where 
fi G are relatively prime polynomials such that fa = (X — a) 2 for some 

a G F p and fa is squarefree of degree n — 2; indeed, this implies (2). 

In this note, we show that, in some sense, "most" polynomials / satisfy these two 
conditions, hence "most" jacobians of hyperelliptic curves have maximal monodromy 
modulo all but finitely many primes (which may, a priori, depend on the polynomial, 
of course!). 

More precisely, for k and Z/% as above, let us denote 

= {/ G ZfcpT] I / is monic of degree n}, 
and let the height be defined on J- n by 

H(a + a 1 X-\ h a n -iX n ~ l + X n ) = max H(ai), 

0<i<n—l 

where iV is the norm from k to Q and H is any reasonable height function on k, 
e.g., choose a Z-basis (wj)i<i<d °f ^fc> where d = [k : Q], and let 

H{axUJi H h a^Wrf) = max \cti\, 

for all (ai) G Z '. 

Let FniT) denote the finite set 

(4.1) Fn(T) = {/ € ^ n I (/) < T}. 

We have |.F„(T)| = iVfc(T) n , where 

N k (T) = \{x G Z fc I H(x) < T}\ x T d , where d = [Jfe : Q]. 

Say that / has big monodromy if the Galois group of its splitting field is & n . We 
will show: 



8 



CHRIS HALL 



Proposition 10. Let k and Z^ be as above. Then 

\{f € F n {T) | / does not have big monodromy}\ < Nk (T) n-1 / 2 (log Np, (T) ) , 
for all T > 2, where the implied constant depends on k and n. 

Say that / E T n has ordinary ramification if it satisfies condition (2') above. 

Proposition 11. Let k and 6e as above, and assume n > 2. There exists a 
constant c > 0, depending on n and k, such that we have 

\{f £ J'niT) | / does not have ordinary ramification}] <C -n- — frr ^s 

V k\ ) ) 

for T > 3, where the implied constant depends on k and n. 

Finally, say that Jf has big monodromy if the image of pf/ is as big as possible for 
almost all primes I. 

Corollary 12. Assume that n>2. Then we have 

^lim |{/ G F n (T) I ^/ /iave monodromy}\ = 0. 

Remark 13. Quantitatively, we have proved that the rate of decay of this probability 
is at least a small power of power of logarithm, because of Proposition [TTJ With 
more work, one should be able to get c equal or very close to 1, but it seems hard 
to do better with the current ideas (the problem being in part that we must avoid 
/ for which the discriminant is a unit in which may well exist, and sieve can 
not detect them better than it does discriminants which generate prime ideals, the 
density of which could be expected to be about (log iV^T)) -1 ). 



For both propositions, in the language of [Klj . we consider a sieve with data 

(J T n, {prime ideals in Z&}, {reduction modulo p}), (T n (T) , counting measure), 
and we claim that the "large sieve constant" A for the sifting range 

C* = {p C Z fc | Np < L} 

satisfies 

A<iV fe (T) n + L 2n , 

where the implied constant depends only on k. Indeed, this follows from the work 
of Huxley |Huj . by combining in an obvious manner his Theorem 2 (which is the 
case n = 1, k arbitrary) with his Theorem 1 (which is the case k = Q, n arbitrary). 

Concretely, this implies that for arbitrary subsets f2 p in the image of J- n under 
reduction modulo p — the latter is simply the set of monic polynomials of degree n 
in F p [X], and has cardinality (A^p) n — we have 
(4.2) 

lfy>l 



\{fEF(T) | /(modp)^fi p foriVp<L}|«(iV fc (Tr+L 2 ")(^ J] 



(Np) n - 1 n p | 

Na<L p\a v T ' v[ 
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where the sum is over squarefree ideals in with norm at most L, and therefore 

also 

(4.3) 

|{/ G HT) | /(modp) i n p for Np < L}\ « (Nk(T) n + L 2n ) ( £ 

Np<L ^ V) 

Proposition [10] is a result of S.D. Cohen [C] ; it is also a simple application of the 
methods of Gallagher [G] (one only needs (|4.3I) here), the basic idea being that 
elements of the Galois group of the splitting field of a polynomial / are detected 
using the factorization of / modulo prime ideals. We recall that the first quantitative 
result of this type (for k = Q) is due to van der Waerden [vdWj , whose weaker result 
would be sufficient here (though the proof is not simpler than Gallagher's). 

Proof of Proposition Let p C be a prime ideal, and let O p be the set of 
polynomials / G which are monic of degree n and factor as described in 

Condition (2'). We claim that, for some constant c > 0, c < 1 (depending on k and 
n), we have 

(4.4) -JM. > 

for all prime ideals with norm iVp > Pq, for some Po depending on k and n. 

Indeed, for n > 4, we have clearly 

> (Np) x |{/ G F p [X] | deg(/) = n - 2, / monic irreducible}); 

for n = 2, this holds with the convention that 1 is irreducible of degree 0, and for 
n = 3, we must subtract 1 from the second term on the right. If n = 2, we are done, 
otherwise it is well-known that 

n-2 

\{f G FJX] I deg(/) = n — 2, / monic irreducible}! ~ 

n — 2 

as g — > +oo, hence the lower bound (|4.4p follows by combining these two facts 
(showing we can take for c any constant < (n — 2) _1 if Pq is chosen large enough; 
using more complicated factorizations of the squarefree factor of degree n — 2, one 
could get c arbitrarily close to 1). 



Now we apply (|4.3ft with this choice of subsets for p with norm > Pq, and with 
n p = for other p. We take L = N k {T) d / 2 , assuming that L > Po, i.e., that T is 
large enough. Since, if / G J~ n {T) does not have ordinary ramification, we have by 
definition / (modp) ^ J7 p for any p, it follows by simple computations that 

|{/ G J~ n {T) | / does not have ordinary ramification} | <S NkiT^H^ 1 

where the implied constant depends on k and 

Na<L 
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b 

where now ^ restricts the sum to squarefree ideals not divisible by a prime ideal 
of norm < Pq, and where uj(a) is the number of prime ideals dividing a. 

It is then a standard fact about sums of multiplicative functions that 

(logL) c 

for L large enough (depending on Pq; recall that < c < 1), and this leads to the 
proposition, since L and Nk(T) are comparable in logarithmic scale. □ 
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